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NASA’s Earth Science Data Systems & 


me “Advance understanding of Earth and develop 
technologies to improve the quality of life on our 
home planet.” -- 2014 NASA Strategic Plan 


u NASA’s Earth Science Data Systems Program 
directly supports this strategic goal by providing 
end-to-end capabilities to deliver data and 
information products to users 


es NASA’s Earth Science Data and Information 
Policy promotes usage of data by the community 
¢ No period of exclusive access - Data are available after initial 
checkout 


¢ Data available at no cost to all users on a non-discriminatory 
basis except where agreed upon with international partners 


Core and Community Capabilities & 


=u Core Capabilities 


> Basic operational capabilities to process, archive, manage and 
distribute data from NASA missions 
“*Earth Observing System Data and Information System (EOSDIS) 


x Community Capabilities 
> Peer-review-selected projects 
> New data products — Making Earth System Data Records for 
Use in Research Environments (MEaSUREs) 
> Research in Earth Science Informatics to feed into the 
evolution of the core components 
“*Applied Information Systems Technology (AIST) 
«Advancing Collaborative Connections for Earth System Science 
(ACCESS) 
x Core-Community collaboration through Earth Science 
Data System Working Groups (ESDSWG) 


Earth Observing System Data and 
Information System (EOSDIS) 


a Operating since August 1994 


= Provides end-to-end capabilities for 
managing NASA’s Earth science data. 


> Science Operations 
«*Science data processing 
«*Data management 
“*Interoperable distributed data archives 
«On-line data access services 
«Earth science discipline-oriented user services 
> Network Data Transport to distributed 
system elements 


Extensive 


s >11,000 data types 
(collections) 


e Land 
» Cover & Usage 
» Surface temperature 
» Soil moisture 
» Surface topography 
e Atmosphere 
» Winds & Precipitation 
» Aerosols & Clouds 
» Temperature & Humidity 
» Solar radiation 
e Ocean 
» Surface temperature 


» Surface wind fields & 
Heat flux 


» Surface topography 
» Ocean color 
e Cryosphere 
» Sea/Land Ice & Snow Cover 


i Primary Of 
Hl Extended Ops 


¢ Human Dimensions 
» Population & Land Use 
» Human & Environmental Health 
» Ecosystems 


Net Primary Productivity is the amount of carbon absorbed by plants minus 
carbon released by plants, measured in grams of carbon per square meter per 
day. Image shows the averages over October 2016, globally. Credits - Image 
made by Reto Stockli, NASA's Earth Observatory Team, using data provided by 
the MODIS Land Science Team. 
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Top of Atmosphere Radiation 


At the top of the atmosphere (TOA), incoming and outgoing radiation determine Earth’s average 
temperature. This image shows averaged net downward TOA radiation from the Clouds and Earth’s 
Radiant Energy System (CERES) instrument from 2001 to 2010. The Southern Hemisphere receives 
more net radiation than the Northern Hemisphere. (Courtesy D. Frierson et al., 2013, Nature 
Geoscience) -— accessed through https://earthdata.nasa.gov/user-resources/sensing-our- 
planet/rooting-out-rainfall 
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Aerosol particle sizes — red = small (man made); green = large (natural); yellow = mixed. 
Map based on data from MODIS instrument on NASA's Terra satellite. 
http://earthobservatory.nasa.gov/GlobalMaps/view.php?d1=MODAL2_M_AER_RA 
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This image of Aquarius sea surface salinity (SSS) measurements averaged for 2012 shows a global 
color scale of salinity intensity. Warm colors mark stronger salinity values. Values are shown ina 


range between 30 grams per kilogram (purple) and 40 grams per kilogram (red). (Courtesy N. 


Kuring/NASA) — accessed through https://earthdata.nasa.gov/user-resources/sensing-our-planet/salt- 
of-the-sea. 


Distributed Active Archive 
OX =) a) (=) gm (DYAV-Os-9) 


Alaska Satellite 


Facility DAAC 
SAR Products, Sea Ice, - . 
Polar Processes, Socioeconomic 
Geophysics Data and 
Goddard Earth a 
i enter 
ae Land Processes Sciences 


Human Interactions, 
DAAC Data and Land Use, 


Land Cover, Surface Information Environmental 
Reflectance, Radiance, Services Center Sustainability, 
Temperature, Topography, Global Precipitation, Geospatial Data 


Vegetation Indices Solar Irradiance, \j " 
National Snow Atmospheric 


Composition and 
and Ice Data Dynamics, aia 
Center DAAC 
Frozen Ground, 


Glaciers, 


Ice Sheets, Sea Ice, Crustal Ocean Biology 
Physical Snow, Soil Moisture \‘ Dynamics Data | DAAC 


Oceanography DAAC Information Ocean Biology, 
Gravity, Sea Surface System Ww Sea Surface 


Temperature, Ocean Winds, Space Geodesy, Temperature 
Topography, Circulation & Solid Earth 


Currents 
5 Level 1 and 
’ d LaRC Atmosphere 


Global Hydrology Atmospheric Archive and 
Resource Center DAAC /-<aalllll @ Science Data Distribution 


__,pazardous Weather, Center System (LAADS) 
Lightning, Tropical Cyclones Radiation Budget, MODIS Level-1 
. sand Clouds, Aerosols, and Atmosphere 


Tropospheric Data Products 
Chemistry 


Oak Ridge National 
Laboratory DAAC 


Biogeochemical Dynamics, 


Ecological Data, 
Environmental 


oo 
National Aeronautics and Space Administration NASA 
“ ~ \ 


Science Investigator-led 
Processing Systems 


SIPSs perform forward processing 
fo) merc laler-laem e)aereleceqa-mmr-lale 
reprocess data to incorporate 
algorithm improvements. 


www.nasa.gov 


Large & Growing Archive & Distribution Volumes Sy 


Petabytes 
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EOSDIS Product files Delivered: FY2000 thru FY2016 


1,600 


1,400 


EOSDIS Science Data Products 
Distribution: FY 2000 through FY 2016 


1,200 


NOTE: FY = Fiscal Year; FY 2016 is 
Oct. 1, 2015 to Sept. 30, 2016 
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Recent and On-Going Developments (1 of 2) af 


a Land and Atmosphere Near real-time 
Capability for EOS (LANCE) 


= Coherent Web Interface: 
http://earthdata.nasa.gov is operational 


¢ Provides a unified view of NASA Earth science data 
system resources 


¢ Consolidates 14 web sites, and provides links to 
various ways to access data and to related external 
sites 


a User Registration System & earthdata 
login — uniform approach to registration 
across and access to EOSDIS 
components 's 


Recent and On-Going Developments (2 of 2) af 


a Global Imagery Browse Services (GIBS) 


¢ Standards-based, full resolution, interactive 
browse capability 


¢ Accessible from http://earthdata.nasa.gov wiki 
we Unified Metadata Model and Common 
Metadata Repository 


= Big Earth Data Initiative (BEDI) 
=u Preservation Content Specification 
a Digital Object Identifiers 


¢ ESDIS Project is a registration authority (prefix 
10.5067) 


¢- DOI’s assigned to > 50% of datasets 
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Land, Atmosphere Near-real-time Capability for EOS 
(LANCE) 


¢ Building on existing EOSDIS elements provides data from AIRS, AMSR, 
MISR, MLS, MODIS, OMI, and VIIRS instruments in near real-time (< 3 hours 
from observation) 


e Utilizes software for Standard Science Products, but relaxes requirements 
for ancillary data inputs 


Earth Science Data Operations 


H 7 h . il ili ~ Earth Science Mission Operations ’ ; 
‘ b 
igh operational availability ages: 


EOS Spacecraft § = Pomme RED 5) pee . 
, , : v4 ft —_aome gaara 
¢ Applications of LANCE Px jo 18 > ae 
Torss| # © 2 MLS SIPS es 
data include: me piz\a| a, 
s £2 
. = / —> ie ) \ 8 Format: S-PDS ane 
Bue ei) > ae 
— Numerical weather & seria 5| ls roons | 
Ground fe) Q Format: S-PDS ; ay 
1 Stations a —_| > MODIS. Vv ’ 
cl im ate NOAA — NASA con) (iT) (L1, 12, L26*L3*) 
Spacecraft 3 5 Worldview 
1 1 1 , IN| 3 : LAND SIPS 
prediction/forecasting es | B)\ Btomat as 
Suomi NPP wi lV] § ree 
.- . 5 | 
7 Monitoring of Natu ral pee ogee I 7 | Format: L1R via Aspera service 
op. DS eee ee ees 
Hazards oo” 
GCOM-W1 
Disaster Relief fi RBD: Rate Buffered Data 
— le ra SDS: Session Based Production Data Set, T-PDS: Time Based Production Data Set 
Direct Broadcast / ‘ Sr cace ciitgureutronuee viene 
Readout Stations _ TDRSS: Tracking and Data Relay Satellite System 
— Agriculture 


— Air quality 
See: https://earthdata.nasa.gov/earth-observation-data/near-real-time/about-lance 
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LANCE Latencies Sy 


Cumulative Four Weeks Latency Histogram for LANCE Levels 0, 1, & 2 Products 
(15 January - 11 February, 2017) 
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Over the four weeks indicated above, >98% of near real- 


time data requests were satisfied within 3 hours. a 


= What is the Earthdata Website? 


¢ Sustainable, evolvable, and reliable Website = 
representing community needs for NASA 4 
Earth science data and information. = 


¢ Supports collaboration within and between 
organizations, and for development and 
integration of new applications. 


¢ Coherent and comprehensive Web presence 
of the Earth Science Data Systems Program. 


* See Earthdata at https://earthdata.nasa.govi. 


= Benefits of the Earthdata Website: 


* Better represents EOSDIS programmatic 
investments and capabilities. 


* Presents data centers clearly as elements 
within a larger system of systems. 


¢ Facilitates multidisciplinary research and data 
integration. 


* Quickly responds to emerging technologies 


* Provides a platform for demonstration of 
interoperability throughout all of our systems. 


EOSDIS Evolution: Worldview and 
Global Browse Imagery Services 


GIBS / Worldview Goal: 
To transform how users interact with and discover NASA Earth data; make it visual 


Approach: 

“ 
— The Global Imagery Browse Services ) 
(GIBS) provide open access to full > 
resolution imagery derived from NASA 3 
products to any mapping client and es 
script e 
https://earthdata.nasa.gov/gibs z 

— Worldview is an open source, browser- 
based client to interactively explore 6 
GIBS (and SEDAC) imagery and a 


download the underlying data 
https://worldview.earthdata.nasa.gov 
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Global Image Browse Service (GIBS) af 


a Goal: “Parameter Visualizations” for all 
EOSDIS Imagery; ~400 products available now 

= Standardized access via OGC WMTS / TWMS 
/\WMS / KML 


= Source code for the GIBS OnEarth server and 
Sample code available at the GIBS GitHub site 

=u Repository of pre-prepared, hierarchically 
stored imagery to maximize performance for 
“full-resolution” browse 

a Clients can be built to use and display images 
in GIBS — WorldView is an example 
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Worldview: Reference Client for GIBS)“eannasanceqovine 


®% EOSDIS Worldview (Alpha) - Mozilla Firetox - > | |oC=Dh [ms 
File Edit View History Bookmarks Tools Help 

EOSDIS Worldview (Alpha) | + | - 
& @@ NASA [National Aeronautics a... (US) htt e ata.nasa.gov, & + Google Pp & t 


Base Layers 


Corrected Reflectance (True Color) 
Terra / MODIS 


Corrected Reflectance (True Color) 7 
Aqua / MODIS 


Overlays 
Cloud Top Temperature (Night) 
Aqua / MODIS 


Fires (Day and Night) 
Terra/ and Aqua/MODIS Fire and Thermal 
Anomalies 


’ — 
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Data Tools 


mg Search and Order Tools (45) 
ge Data Handling (Read/Ingest, Format 
Conversion, Data Manipulation) (31) 


mg Subsetting and Filtering Tools (Temporal, 
Spatial, Parameter, Channel) (34) 


a Geolocation, Reprojection, and Mapping Tools 
(28) 


ge Data Visualization & Analysis Tools (31) 
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Preserving NASA Earth Science Data & 


= General requirements 
- No loss of bits 
- Discoverability and accessibility 
- Readability 
- Understandability 
- Usability 
- Reproducibility of results 


= NASA has developed Preservation 
Content Specification for Earth Science 
Data 
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Categories of Content to be Preserved Gy 


1. Preflight/Pre-Operations: Instrument/Sensor characteristics including pre- 
flight/pre-operations performance measurements; calibration method; 
radiometric and spectral response; noise characteristics; detector offsets 


2. Science Data Products: Raw instrument data, Level 0 through Level 4 data 
products and associated metadata 


3. Science Data Product Documentation: Structure and format with 
definitions of all parameters and metadata fields; algorithm theoretical basis; 
processing history and product version history; quality assessment 
information 


4. Mission Data Calibration: Instrument/sensor calibration method (in 
Operation) and data; calibration software used to generate lookup tables; 
instrument and platform events and maneuvers 

5. Science Data Product Software: Product generation software and software 
documentation 

6. Science Data Product Algorithm Input: Any ancillary data or other data 
sets used in generation or calibration of the data or derived product; ancillary 
data description and documentation 

7. Science Data Product Validation: Records, publications and data sets 


8. Science Data Software Tools: product access (reader) tools. 


EOSDIS Evolution —- On-Going with 
Community Inputs 


a Earth Science Data System Working Groups (on-going) 


focus on exploration and development of recommendations 
derived from pertinent community insights 
organized around key technology and information system issues 
Members from NASA-funded core and community data system 
activities 
2016-2017 Working Groups 
e Atmospheric Science User Forum Working Group 
e Data Stewardship Interest Area 
— Airborne Metadata Working Group 
— Data Quality Working Group 
— Dataset Interoperability Working Group 
— Search Relevance Working Group 
— Software Citations Working Group 
¢« Geospatial Web Services Working Group 
e Level 2 Data Visualization Working Group 
¢ OPeNDAP Implementation Best Practices Working Group 
e Time Series Working Group 
26 


NASA ESDSWG €> IEEE GRss EsiTc GY 


ESDSWG ESI TC Research Topics 


Atmospheric Science User Interoperability and standards; Web-based 
Forum services and analysis 

Airborne Metadata (DSIA) Data Stewardship 

Data Quality (DSIA) Data Stewardship 

Dataset Interoperability Interoperability and standards; Data 
(DSIA) Stewardship 


|Search Relevance (DSIA) _—i Relevance |Search Relevance (DSIA) _—i Data Stewardship; Data discovery and access 


Software Citations (DSIA) Data Stewardship; Data discovery and access 
Geospatial Web Services Web-based services and analysis 


Level 2 Data Visualization Software tools to visualize and analyze 
lee 
OPeNDAP Implementation Data discovery and access 

hear 


Interoperability and standards 
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Conclusion 


e Earth Science Informatics is a rapidly 
developing discipline 

e Many organizations around the world 
are actively pursuing ESI R & D 


e Considerable commonality of interests 
among these organizations 


e IEEE GRSS ESI TC, ESIP Federation, 
Research Data Alliance (RDA) are 
examples of groups promoting 
collaboration 


si IEEE 


